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1. Introduction. Upon reading the paper Efficient Likelihood Estimation 
in State Space Models by Cheng-Der Fuh I found a number of problems in the 
formulations and a number of mathematical errors. Together, these findings 
cast doubt on the validity of the main results in their present formulation. 
A reformulation and new proofs seem quite involved. 

The paper, Efficient Likelihood Estimation in State Space Models deals 
with asymptotic properties of the maximum likelihood estimate in hidden 
Markov models. The hidden Markov chain is X n , and the observed process 
is where £ n conditioned on the past and the hidden process depends on 
(X n ,£ n _i) only. The approach used is to add an iterated function system 
M n , and to consider the Markov process (X n ,£ n ,M n ). This is very much 
akin to the method in Douc and Matias [1], and I will use this article as a 
background for my comments. 

2. Problems. 

2.1. Definition of iterated function system. The first basic definition in 
the paper is a function Pg (£.,■) : M — > M that maps a function li£M into a 
new function in M (page 2031), 



P e (tj)h(x) = / p e (x,y)f(£ j ;6\y,£ j - 1 )h(y)m(dy). 

JydX 

[It is unclear why the author states that Pg(£j) is a function on (X x H d ) x M 
where X is the state space of the Markov chain.] The paper next defines the 
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composition Pg(^j + i) oP 9 (^)/i by first applying Pg(£j + i) to /i and then 
applying P#(£j) to the result. Using these two definitions we have 



The argument presented in the paper then appears to assume that this 
expression depends on some x and performs an integration before claiming 
that the result is the joint density Pn(£o ? ■ • ■ > £n! 0). This is clearly not correct 
since ~KQ{x n ) appears in the expression instead of ng(xo). 

Following the work of Douc and Matias [1] one would instead use the 
definition 



that is, the integration is with respect to the first variable in po(y, x) instead 
of the second. Changing the definition of Pfl(£o) correspondingly and using 
ordinary composition of functions, one finds that p n (£o> • ■ • > £,n] 8) equals the 
integral of P#(£; n ) o • • • o Pg(^i) o Pe{^o)^e with respect to x n+ \. However, 
making this change necessitates a new proof for the first part of Lemma 
3 on page 2056. Comparing with Douc and Matias ([1], Proposition 1) we 
see that this is one of the places where the latter authors use the stronger 
assumptions of that paper on the Markov chain. 

Turning to the iterated function system, Fuh's paper defines this as 



[formula (5.6), page 2045]. Taking this literally, and using the definitions 
in Fuh's paper, this is actually a mapping that takes a function as input 
and turns it into a constant. Instead M n should be a function obtained by 
applying a mapping to M n —\. This is achieved when using the definition 
suggested in (1) and adding ttq to the right-hand side of M n above. 

2.2. Harris recurrence of iterated function. Whether or not we make the 
changes suggested in the previous subsection, M n , defined on page 2045, is 
related to the density of (£o>--->£n)- Making the change suggested in (1) 
above we have precisely M n (x n+ i) = p(x n+ i,£o, . . . ,£„). Such an expression 
will typically tend to either zero or infinity. However, in Lemma 4 on page 
2046 Fuh claims that (X n ,£ n ,M n ) is a Harris recurrent Markov chain. It is 
difficult to pinpoint the exact origin of this problem. The Harris recurrence 
is established in Lemma 4 which in its formulation uses a measure Q from 
Theorem 1 (in the formulation there are two Q's, but these are different). 




j=n 



'xj-i,Zj)f(€j;0\xj,€j-i)m(dxj) >f(£o;9\x )m(dx ). 



(1) 




M n = P e (£n)°---oP e (£i)oP e (£ ) 
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So we need to establish Theorem 1 before proving Lemma 4. In Lemma 3 it 
is stated that the Markov iterated function system satisfies Assumption K. 
In Remark 1 (page 2035) Fuh says that Assumption K is different from the 
assumptions of Theorem 1. He then goes on to say that if Assumption K is 
supplemented with the extra assumption that (Y n ,M n ) is a Harris recurrent 
Markov chain, then Theorem 1 still holds. This, therefore, seemingly looks 
like a circular argument. 

Comparing again with Douc and Matias [1] they consider instead M n (x n +i) = 
p(x n+ i |£o, • ■ • > £n)- However, if we make this change we have introduced a new 
iterated function system, and a revised version of Lemma 3 is needed which 
presumably will lead to a different set of assumptions. 

2.3. Asymptotic properties of score function and observed information. 
The asymptotic normality of the score function is stated in Lemma 6 (page 
2048). In the proof of Lemma 6 (page 2060) the author appeals to Corollary 
1. The latter gives a central limit theorem for a sum of the form Y^j=i 
However, the paper wants to use this result on the sum 5Zj=i ^fl(M,_i,Mj). 
This looks innocent, but since 9 appears in the iteration of M n this is not on 
the form ^2™ =1 g(Mj-i,Mj). Instead one needs to consider a new iterated 
function system. This is what is done in Appendix D of Douc and Matias 

[!]• 

Similarly, it is stated that the proof of the main Theorem 5 follows a stan- 
dard argument. However, comparing with Douc and Matias [1] (Appendix 
D.3) it seems that yet another iterated function system is needed to deal 
with the convergence of the observed information. 

2.4. Generality of conditions. Assumption C5 on page 2043 restricts the 
dependency of the observed process on the hidden process. For the example 
considered in (b) on page 2044 one needs to consider 

HZo;0\y)m;Q\y,Zo) 
S HZo;e\z)m;e\z,Zo) 

exp{-l/2(g -s/) 2 -l/2(&-y) 2 } 
S exp{-l/2(£ - zf - 1/2(6 - z) 2 } 

= sup exp{z 2 - y 2 + (£ + £i)(y ~ z)} = °o- 

y,zeX 

Thus C5 is not satisfied (this seems to be contrary to the claim on page 2054 
line 8 from the bottom). 

REFERENCES 

[1] Douc, R. and Matias, C. (2001). Asymptotics of the maximum likelihood estimator 
for general hidden Markov models. Bernoulli 7 381-420. MR1836737 



4 



J. L. JENSEN 



Department of Mathematical Sciences 
University of Aarhus 
DK-8000 Aarhus C 
Denmark 

E-MAIL: jlj@imf.au.dk 



